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Abstract. We study the self-assembly of a complex network of collaborations among 
self-interested agents. The agents can maintain different levels of cooperation with 
different partners. Further, they continuously, selectively, and independently adapt 
the amount of resources allocated to each of their collaborations in order to maximize 
the obtained payoff. We show analytically that the system approaches a state in 
which the agents make identical investments, and links produce identical benefits. 
Despite this high degree of social coordination some agents manage to secure privileged 
topological positions in the network enabling them to extract high payoffs. Our 
analytical investigations provide a rationale for the emergence of unidirectional non- 
reciprocal collaborations and different responses to the withdrawal of a partner from 
an interaction that have been reported in the psychological literature. 
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Cooperation is the basis for complex organizational structures in biological as well 
as in social systems [l|, The evolutionary and behavioural origin of cooperation is a 
subject of keen scientific interest, because the ubiquity of cooperation in nature seems 
to defy the often high costs incurred by the cooperating agent j^. Evolutionary game 
theory has identified several mechanism allowing for the evolution and persistence of 
costly cooperation j^. In particular the emergence of cooperation is promoted if the 
interacting agents are distributed in some (potentially abstract) space, so that only 
certain agents can interact at any given time [5|47| • In the context of social cooperation 
spatial structure can be appropriately modeled by a complex network, in which nodes 
represent agents, while the links correspond to collaborations. The topology of this 
network, i.e., the specific configuration of nodes and links, has been shown to be of 
central importance for the level of cooperation that evolves 



In social networks the topology is not static, but reacts to the behaviour of the 



agents 



13-18 



This defines an inherent dynamical interplay: While the agents's 
behaviour may depend on their topological neighbourhood, this neighbourhood is, at 
least in part, shaped through the agent's behavioural choices. Networks containing such 
an dynamical interplay between the state of the nodes and the networks topology are 
called adaptive networks 19|, |20j . While adaptive networks have been studied for some 
time in the social literature 
recently triggered a wave [2 



e.g 



13|, |21|, 122|), pioneering work |23|, M, l26|, |27l only 
of detailed dynamical investigations in physics. Recent 
ublications discuss simple cooperative games such as the one-shot prisoner's dilemma 



28|-|39[, the iterated prisoner's dilemma 40[, and the snowdrift game 3ll, l32|, |41 



on adaptive networks. They showed numerically and analytically that a significantly 
increased level of cooperation can be achieved if individuals are able rewire their links 
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if links are formed and broken 
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or if new agents are 



added to the network 36|, l37|]. Moreover, it has been shown that the adaptive interplay 
between the agents' strategies and the network topology can lead to the emergence of 
distinguished agents from an initially homogeneous population 



While important progress has been made in the investigation of games on adaptive 
networks, it is mostly limited to discrete networks, in which the agents can only assume 
a small number of different states, say, unconditional cooperation with all neighbours 
and unconditional defection. By contrast, continuous adaptive networks have received 
considerably less attention 22|, |4J, |45(| . Most current models therefore neglect the ability 
of intelligent agents to maintain different levels of cooperation with different self-chosen 
partners 
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In this paper we propose a weighted and directed adaptive network model in which 
agents continuously and selectively reinforce advantageous collaborations. After a brief 
description of the model, we show in Sec. [2] that the network generally approaches 
a state in which all agents make the same total cooperative investment and every 
reciprocated investment yields the same benefit. Despite the emergence of this high 
degree of coordination, the evolved networks are far from homogeneous. Typically the 
agents distribute their total investment heterogeneously among their collaborations, and 
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each collaborations receives different investments from the partners. In Sec. [31 we show 
that this heterogeneity enables resource fluxes across the network, which allow agents 
holding distinguished topological positions to extract high payoffs. Thereafter, in Sec. HI 
we investigate further topological properties of the evolved networks and identify the 
transition in which large cooperating components are formed. Finally, in Sec. El we 
focus on the appearance of unidirectional (unreciprocated) investments. Specifically, 
we identify three distinct scenarios in which unidirectional collaborations can arise and 
discuss their implications for the interaction topology. Our conclusions are summarized 
in Sec. |6l 



1. Model 



We consider a population of agents, representing for instance people, firms or nations, 
engaged in bilateral collaborative interactions. Each interaction is described by a 
continuous snowdrift game one of the fundamental models of game theory. In 
this game, an agent i can invest an amount of time/ money /effort Cij G M.q into the 
collaboration with another agent j. Cooperative investments accrue equal benefits B to 
both partners, but create a cost C for the investing agent. Assuming that investments 
from both agents contribute additively to the creation of the benefit, the payoff received 
by agent i from an interaction with an agent j can then be written as 

Pij = B {eij + Cji) - C idj) . (1) 

The game thus describes the generic situation in which agents invest their personal 
resources to create a common good shared with the partner. 

As an example of the snowdrift game, the reader may think of a scientific 
collaboration where two researchers invest their personal time in a project, while the 
benefit of the publication is shared between them. This example makes it is clear that 
the benefit of the collaboration must saturate when an extensive amount of effort is 
invested, whereas the cost to the an agents, measured for instance in terms of personal 
well-being, clearly grows superlinearly once the personal investment exceeds some hours 
per day. 

In the following we do not restrict the cost- and the benefit-functions, B and C, to 
specific functional forms, except in the numerical investigations. However, we assume 
that both are differentiable and, moreover, that B is sigmoidal and C is superlinear 
(cf. Fig. [Sj). These assumptions capture basic features of real- world systems such as 
inefficiency of small investments, saturation of benefits at high investments, as well as 
additional costs incurred by overexertion of personal resources and are widely used in 
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the sociological and economic literature 

To account for multiple collaborations per agent, we assume that the benefits 
received from collaborations add linearly, whereas the costs are a function of the sum 
of investments made by an agent, such that the total payoff received by an agent i is 
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given by 

where Ej := Ylf=i ^ij denotes the total investment of the agent i while aij := Cy + Cji 
denotes the total investment made in the collaboration ij. This is motivated by 
considering that benefits from different collaborations, say different publications, are 
often obtained independently of each other, whereas the costs generated by different 
collaborations stress the same pool of personal resources of an agent. 

Let us emphasize that we do not restrict the investment of an agent further. 
While investments cannot be negative, no upper limit on the investments is imposed. 
Furthermore, the agents are free to make different investments in collaborations with 
different partners. Thus, to optimize its payoff, an agent can reallocate investments 
among its potential partners as well as change the total amount of resources invested. 

For specifying the dynamics of the network, we assume the agents to be selfish, 
trying to increase their total payoff Pi by a downhill-gradient optimization 

Every agent can cooperate with every other agent. Thus, the network of potential 
collaborations is fully connected and the deterministic time-evolution of the model 
system is given by a system of A^(A^ — 1) ordinary differential equations of the form 
of Eq. [3l The network dynamics, considered in the following, is therefore only the 
shifting of link weights Cij. Note however that already the weight dynamics constitutes 
a topological change. As will be shown in the following, the agents typically reduce 
their investment in the majority of potential collaborations to zero, so that a sparse and 
sometimes disconnected network of non-vanishing collaborations is formed. Therefore 
the terminology of graph theory is useful for characterizing the state that the system 
approaches. Below, we use the term link to denote only those collaborations that 
receive a non- vanishing investment a^. A link is said to be bidirectional if non- 
vanishing investments are contributed by both connected agents, while it is said to 
be unidirectional if one agent makes a non-vanishing investment without reciprocation 
by the partner. Likewise, we use the term neighbours to denote those agents that are 
connected to a focal agent by non- vanishing collaborations and the term degree to denote 
the number of non- vanishing collaborations in which a focal agent participates. 

In the following, the properties of the model are investigated mostly by analytical 
computations that do not require further specifications. Only for the purpose of 
verification and illustration we resort to numerical integration of the ODE system. For 
these we use the functions 

For studying the time-evolution of exemplary model realizations by numerical 
integration, all variables e^j are assigned random initial values drawn independently 
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Figure 1. Network of collaborations in 
the final state. The nodes represent agents, 
links correspond to collaborations receiving 
non- vanishing investments aij. The small 
dash on every link ij is a fairness indicator: 
the further it is shifted toward one agent 
i, the lower the fraction, etj/crij, of the 
investment agent i contributes to the link. 
Agents extracting more payoff are shown 
in darker colour and arc placed toward the 
center of the community. The size of a dot 
indicates the agents total investment S^. In 
the final configuration the network exhibits 
a high degree of heterogeneity. Nevertheless 
all agents make the same total investment 
and all collaborations receive the same total 
investment. (Parameters: p ~ 0.65, r = 0.1, 



from a Gaussian distribution with expectation value 1 and standard deviation 10~^^ 
constituting a homogeneous state plus small fluctuations. The system of differential 
equations is then integrated using Euler's method with variable step size h. In every 
timestep, h is chosen such that no variable is reduced by more than half of its value in 
the step. If in a given timestep a variable e^j falls below a threshold e << 1 and the 
corresponding time derivative is negative, then dej^/dt is set to zero for one step to avoid 
very small time steps. We emphasize that introducing the threshold e is done purely to 
speed up numerical integration and does not affect the results or their interpretation. 
In particular, we confirmed numerically that, the exact value of e does not influence the 
final configuration that is approached. In all numerical results shown below e = 10~^ 
was used. 

2. Coordination of investments 

The numerical exploration of the system reveals frustrated, glass-like behavior; starting 
from a homogeneous configuration as described above, it approaches either one of a large 
number of different final configurations, which are local maxima of the total payoff. 

A representative example of an evolved network, and snapshots from the time- 
evolution of two smaller example networks are shown in Figs. [T|2| respectively. In the 
example networks only those links are shown that receive a non-vanishing (i.e. above- 
threshold) investment. Most of these non- vanishing links are bidirectional, receiving 
investments from both of the agents they connect. Only rarely, unidirectional links 
appear, which are maintained by one agent without reciprocation by the partner. 

For further investigations it useful to define a bidirectionally connected component 
(BCC) as a set of agents and the bidirectional links connecting them, such that, starting 
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Figure 2. Time evolution of example networks from a homogeneous state. The 
different frames show snapshots of the network of collaborations at different times, a) 
In small systems the network sometimes self-organizes to homogeneous topologies in 
which all players extract the same payoff, b) If a player (arrow) tries to maintain too 
many links at too low investment, his partners will cease reciprocating investments, 
leading sometimes to unidirectional links. 

from one agent in the set, every other agent in the set can be reached by following a 
sequence of bidirectional links. In the numerical investigations we observe that all 
bidirectional links within a BCC receive the same total investment in the final state. 
However, the investment cjjj made in every given link is in general not split equally 
among the two connected agents. Furthermore, all agents within a BCC make the 
same total cooperative investment Ej in the final state. However, the investments e^j 
of one agent in different collaborations are in general different. The coordination of 
total investments aij, Sj therefore arises although no agent has sufficient information to 
compute the total investment made by any other agent. 

We emphasize that the level of investments, which the agents approach is not set 
rigidly by external constraints but instead depends on the topology of the network of 
collaborations that is formed dynamically. This is evident for instance in differences of 
up to 20 % between the level of investment that is reached in different BCCs of the 
same network. 

To understand how coordination of investment arises, we now formalize the 
observations made above. We claim that in our model in the final state the following 
holds: Within a BCC (i) every agent makes the same total investment, and (ii) either all 
bidirectional links receive the same total investment or there are exactly two different 
levels of total investment received by bidirectional links. For reasons described below, 
the case of two different levels of total investment per link is only very rarely encountered. 
In this case every agent can have at most one bidirectional link that is maintained at 
the lower level of investment. 

We first focus on property (i). This property is a direct consequence of the 
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Figure 3. Adjustment of investments. Shown are the perceived cost functions C and 
benefit functions B (insets) for the example of an agent 1 of degree one interacting 
with an agent 2 of degree two (sketched). The function B depends on the sum of both 
agents' investments into the interaction while C depends on the sum of all investments 
of one agent. In every equilibrium (SE or UE) stationarity demands that the slope 
of these functions is identical. This requires that the agents make identical total 
investments. In stable equilibria (SE), the operating point lies in general above the 
inflection point (IP) of B, whereas equilibria found below the IP are in general unstable 
(UE). Therefore, in a stable equilibrium both links produce the same benefit and both 
agents make the same total investment. 



stationarity of the final state. Consider a single link ij. Since both investments, Cij 
and eji, enter symmetrically into atj, the derivative of the benefit with respect to 
either investment is dB{aij) / deij = dB{aji) /dcji =: B'{aij). Thus, if eij,eji > 0, 
the stationarity conditions de^j/dt = deji/dt = require 

^ C{J:,) = B'{a,,) = ^C{J:,). (4) 



This stipulates that the slope of the cost of the two interacting agents must match the 
slope of the shared benefit in the stationary state (Fig. [3]). Due to the symmetry of Sj, 
dC{Ei)/deij = dC{T.i)/deik =: C"(Si) holds for all i,],k. Therefore, Eq. ^ implies 
C"(Sj) = C'iTjj). As we assumed C to be superlinear, C is injective and it follows that 
Sj = =: S, such that i and j, are at a point of identical total investment. Iterating 
this argument along a sequence of bidirectional links yields (i). 

Let us remark that the stationarity of vanishing investments may be fixed due to 
the external constraint that investments have to remain non-negative. The stationarity 
condition for vanishing and uni-directional links, analogous to Eq. ([1]), is therefore 

^-C(S,)>i?'K)<7S^C'(S,). (5) 



Because of the inequalities that appear in this equation, the argument given above does 
not restrict the levels of total investment found in different components. For similar 
reasons agents that are only connected by unidirectional links can sustain different 
levels of investment, which is discussed in Sec. El 
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We note that, although the network of potential interactions is fully connected, 
no information is transferee! along vanishing links. Therefore, the equation of motion, 
Eq. ini should be considered as a local update rule, in the sense that it only depends on 
the state of the focal agent and on investments received from a small number of direct 
neighbours. 

In order to understand property (ii) we consider multiple links connecting to a 
single agent i. In an equilibrium the investment into each of the links has to be such 
that the slope of the benefit function of each link is identical. Otherwise, the payoff 
could be increased by shifting investments from one link to the other. Since the benefit 
function is sigmoidal, a given slope can be found in at most two points along the curve: 
one above and one below the inflection point (IP). By iteration, this implies that if a 
stationary level of investment is observed in one link, then the investment of all other 
links of the same BCC is restricted to one of two values, which amounts to the first 
sentence of (ii). 

For understanding why the case of two different levels of investments is rarely 
encountered the stability of steady states has to be taken into account. A local 
stability analysis, based on linearisation and subsequent application of Jacobi's signature 
criterion, is presented in the appendix. We show that for a pair of agents ij connected 
by a bidirectional link, stability requires 

C"(S,) > A 2B"{a,,) - C"(S,) < 0, (6) 

and every pair of links ij and ik connecting to the same agent i has to satisfy 

B"ia,k)B"ia,,) > C"(S,) {B"{a,,) + B"{a,j)) . (7) 
>o 

Note that Eq. (|6]) does not stipulate the sign of B"{aij) as it only implies 2B"{aij) < 
C"(Sj) > 0. As Eq. applies also to the link ik, the same holds for B"{aik)- We 
therefore have to consider three different cases when testing the compatibility of Eq. ([7]) 
with Eq. (E]): 

a) B"{(Jik) < and B"[aij) < 0, (both investments above the IP) 

b) B"{aii) > and B"{aij) > 0, (both investments below the IP) 

c) B"{aik) > and B"{(Jij) < (one investment above and one below the IP). 

In case a), Eq. ([7]) is trivially fulfilled as the left hand side has positive and the right 
hand side negative sign. In case b), Eq. ([7]) and Eq. ([6]) are incompatible: estimating 
the lower bound of the right hand side of (I7j) using the relation C"(S) > 2B"{aij) leads 

to the contradiction 

■.=x>o 

B"ia,k)B"ia,,) > C"(S,) (B"(a,fc) + B"ia,,)) 

> 2B"ia,,) {B"ia,k) + 5"(a,,)) = 2B"ia,, ) B"{a,k) + 2{B"{a,^)f . 

=2X >0 

This shows that in a stable stationary state, every agent can at most have one link 
receiving investments below the IP. In case c), Eq. ([7]) can in principle be satisfied. 
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However, the equation still imposes a rather strong restriction on a positive B" {(Tik) 
requiring high curvature of the benefit function close to saturation. The restriction 



becomes stronger, when the degree of agent i increases 48 



Bilateral links with investments below the IP can be excluded entirely, if the 
benefit function approaches saturation softly, so that the curvature above the inflection 
point remains lower or equal than the maximum curvature below the inflection point. 
For such functions, every pair (Tj^ < aij of solutions to the stationarity condition 
B'{a,j) = B'{a,k) = C" (S^) yields a pair of coefficients B" {a,k) > 0, 5" (ay) < 
violating (j7j). In this case only configurations in which all links receive investments 
above the IP can be stable and hence all links produce the same benefit in the stable 
stationary states. This explains why the case of two different levels of cooperation is 
generally not observed in numerical investigations if realistic cost and benefit functions 
are used. 

For understanding the central role the IP plays for stability consider that in the IP 
the slope of B is maximal. Therefore, links close to the IP make attractive targets for 
investments. If the total investment into one link is below the IP then some disturbance 
raising (lowering) the investment increases (decreases) the slope, thus making the link 
more (less) attractive for investments. Hence, below the IP, a withdrawal of resources 
by one of the partners, no matter how slight, will make the collaboration less attractive, 
causing a withdrawal by the other partner and thereby launching the interaction into 
a downward spiral. Conversely, for links above the IP the gradual withdrawal of 
resources by one partner increases the attractiveness of the collaboration and is therefore 
compensated by increased investment from the other partner. In psychology both 
responses to withdrawal from a relationship are well known 49|]. The proposed model 
can therefore provide a rational for their observation that does not require explicit 
reference to long term memory, planning, or irrational emotional attachment. 

For our further analysis property (ii) is useful as it implies that, although our model 
is in essence a dynamical system, the BCCs found in the steady states of this system 
can be analyzed with the tools of graph theory for undirected graphs. In the Sees. [3l 
m we go one step further and treat not only the BCC but the whole network as an 
undirected graph. We thereby ignore the differences between directed and undirected 
links in order to study properties such as the degree- and component-size distributions 
before we continue in Sec. [5] with a more detailed investigation of directed links and 
their topological implications. 



3. Distinguished topological positions 

Despite the coordination described above, the payoff extracted by agents in the final 
state can differ significantly. This is remarkable because the agents follow identical 
rules and the network of collaborations is initially almost homogeneous with respect to 
degree, link weights, and neighbourhood. 

Because all bidirectional links in a BCC produce the same benefit, the total benefit 
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Figure 4. Degree heterogeneity in self- 
organized networks of collaborations. 
In comparison to a random graph 
(black), the degree distribution of the 
evolved networks is relatively narrow 
(blue) . Parameters are chosen to obtain 
networks with identical mean degree. 
Results are averaged over 100 networks 
of size N = 100. 



an agent receives is proportional to the degree of the agent. By contrast, the cost 
incurred by an agent does not scale with the degree, but is identical for all agents in 
the BCC, because agents of high degree invest a proportionally smaller amount into 
their collaborations. Topological positions of high degree thus allow agents to extract 
significantly higher benefits without requiring more investment. 

The payoff distribution in the population is governed by the degree distribution pk 
describing the relative frequency of agents with degree k. Figure|4]shows a representative 
degree distribution of an evolved networks in the final state. While the finite width of the 
distribution indicates heterogeneity, the distribution is narrower, and therefore fairer, 
than that of an Erdos-Renyi random graph, which constitutes a null-model for randomly 
assembled network topologies. We verified that variance of the evolved network is below 
the variance of a random graph for the whole range of admissible mean degree A; in a 
network of given size. 

Although the snowdrift game is not a zero-sum game, payoffs cannot be generated 
arbitrarily. In order to sustain the extraction of high payoffs by agents of high degree, 
investments have to be redistributed across the network. In the definition of our model, 
we did not include the transport of resources directly. Nevertheless, a redistribution 
of investments arises indirectly from the asymmetry of the agents' investments. This 
is illustrated in Fig. [5l Consider for instance an agent of degree 1. This agent 
necessarily focuses his entire investment on a single collaboration. Therefore, the partner 
participating in this collaboration only needs to make a small investment to make the 
collaboration profitable. He is thus free to invest a large portion of his total investment 
into links to other agents of possibly higher degree. In this way investments flow toward 

Figure 5. Redistribution of invest- 
ments. Even in small networks invest- 
ments flow toward agents of high con- 
nectivity. This flow is apparent in the 
position of the fairness indicators on the 
links, cf. Fig. [TJ caption. 
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Figure 6. Giant component transition, (a) At fc = 1.91 the expected size (s) of a 
network component changes from 0(1) to 0{N). (b) Even in the relatively small 
networks of 100 nodes a power-law shape starts to appear in the component-size 
distribution obtained from the final states of 750 network realizations with a mean 
degree a mean degree k = 1.91. 



the regions of high degree where high payoffs are extracted. 
4. Formation of large components 

To explore the topological properties of the networks of collaborations in the final state 
further, we performed an extensive series of numerical integrations runs in which we 
varied all parameters in a wide range. These revealed that an important determinant 
of the topology is the mean degree k = 2L/N, where L denotes the number of 
links and the number of agents in the network. Given two evolved networks with 
similar k, one finds that the networks are also similar in other properties such as the 
component-size distribution, clustering coefficient, and the fraction of collaborations 
that are unidirectional. We therefore discuss the topological properties of the evolved 
networks as a function of k, instead of the original model parameters. 

We first consider the expected size (s) of a network component to which a 
randomly chosen agent belongs. In contrast to the BCC's discussed above, unidirectional 
collaborations are now taken into account in the computation of component sizes. The 
value of (s) in the evolved network as a function of k is shown in Fig. [6^. The 
figure reveals that large components begin to appear slightly below k = 2. Because 
of the difficulties related to integrating A^(A^ — 1) differential equations, our numerical 
investigations are limited to networks of up to 100 agents. While it is therefore debatable 
whether the observed behaviour qualifies as a phase transition, it can be related to the 
giant component transition commonly observed in larger networks. 

In the giant component transition a component is formed that scales linearly with 



network size. In the absence of higher correlations the transition occurs at g = 1 50 



where q is the mean excess degree of the network, i.e., the number of additional links 
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found connected to a agent that is reached by following a random link. 

In Erdos-Renyi random graphs, q = k, therefore the giant component transition 
takes place at A; = 1. In the present model the transition in (s) is shifted to higher values 
of k because of the nature of the underlying snowdrift game. The snowdrift game favors 
cooperation in the sense that for an agent of degree zero it is always advantageous to 
initiate an interaction. Therefore A; = 1 is the lowest possible value that can be observed 
in evolved networks. Further, any evolved network with k = 1 invariably consists of 
isolated pairs, which precludes the existence of a giant component. Finally, the relatively 
narrow degree distribution of the evolved networks implies q < k and therefore k > 1 
at the transition. 

To estimate an upper limit for the connectivity at which the giant component 
transition occurs, it is useful to consider degree homogeneous networks. In these 
networks the degree distribution is a delta function and q = k — 1, so that the transition 
occurs at = 2. In the networks evolved in the proposed model we can therefore expect 
a critical value of k between one and two. Based on numerical results we estimate that 
the giant component transition in the present model occurs at k ^ 1.91 (Fig. [6]). At 
this value a power-law distribution of component sizes, which is a hallmark of the giant- 
component transition, begins to show already in relative small networks with N = 100. 

5. Unreciprocated collaborative investments 

While in Sec. |2] we have mainly considered bidirectional links, and in Secj3] and H] 
only distinguished between vanishing and non-vanishing links, we will now focus on 
unidirectional links, which one partner maintains without reciprocation by the other. 
The presence of such links in collaboration networks was recently discussed in detail by 

3- 

For the discussion below it is advantageous to consider the mean degree of agents 
in a connected component (k) = 21 /n, where n and / are the number of agents and links 
in the component. Note that in large components (k) ^ k while the two properties can 
be significantly different in small components. In contrast to k, (k) allows us to infer 
global topological properties: Components with (k) < 2 are trees. Components with 
(k) = 2 contain exactly one cycle to which trees might be attached. And, components 
with (k) > 2 contain more than one cycle, potentially with trees attached. 

As in the previous section, the term component refers to maximal subgraphs 
which are connected by bidirectional and/or unidirectional links. According to this 
definition a component may, beside one or more BCCs, contain agents, which only have 
unidirectional links. In the following we denote the set of these agents as the non-BCC 
part of the component (nBCC). For the sake of simplicity we focus on components 
which contain only one BCC, but note that the case of multiple BCCs can be treated 
analogously. 

Unlike the BCC, the nBCC is not a subcomponent but only a set of agents which 
are not necessarily connected. Nevertheless, numerical results show that (i*) all nBCC 
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Figure 7. Unidirectional investments and proportion of unidirectional links, (a) The 
ratio between the investment in unidirectional and the investment in bidirectional links 
from the same component, CTn/cr,i, equals 1 for (fc) ~ 2m, m E N. an/cr^ > 1 applies 
to (fc) > 2 7^ 2m, (Tn/fb < 1 to (fc) < 2. (b) For (k) < 2 the average proportion 
of unidirectional links (PUL) features discrete peaks. As every tree must have a 
bidirectional core, the smallest (fc) with non-zero PUL is (k) = 4/3. It corresponds to 
components with 3 agents and 2 links one of which can be unidirectional. 



agents make the same total investment and (ii*) all unidirectional links maintained 
by nBCC agents receive the same total investment a^- While property (ii*) can be 
understood analogously to property (ii) of BCCs, property (i*) cannot be ascribed to 
stationarity or stability conditions but seems to result from optimality restrictions. As 
a consequence of the properties (i*) and (ii*) the number of outgoing links m := Sn/iTn 
is identical for all agents in the nBCC. 

So far we have decomposed a component into the BCC and the nBCC. Within each 
subset, all agents make the same total investment, and all links receive the same total 
investment, therefore each subset can be characterized by two parameters, Eb, cJb for 
BCC and En, cxn for the nBCC. To recombine the subsets and infer properties of the 
whole component, we need to study the relation between these four parameters. 

The central question guiding our exploration is, why do agents not start to 
reciprocate the unidirectional investments. The lack of reciprocation implies that the 
unidirectional links are either less attractive or just as attractive as bidirectional links. 
We distinguish the two scenarios 

a) 5'(ab) = 5'(a,), 
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Figure 8. Topological arrangement of unidirectional links (shown in red), (a) For 
(fc) < 2, unidirectional links connect individual nBCC agents with a BCC core, (b) 
For (fc) > 2 unidirectional links are arranged in long chains which is shown here for 
(fc) =2. For (fc) > 2 typical components become too large to be presented in this way. 



b) B'{a^) > B'M. 

In case a) the unidirectional collaborations are as attractive as targets for investments 
as bidirectional collaborations. In typical networks, where all remaining links receive 
investments above the IP this implies (Jh = <^n = c"- Furthermore, in case a) 
the stationarity condition, Eq. (j4]), requires that C"(Eb) = C"(Sn), which stipulates 
Sb = Sn =: S. Therefore the whole component consists of agents making an investment 
E and links receiving an investment a. 

Conservation of investments within a component implies la = nS and hence 

(k) = 2- = 2-. (8) 

n a 

We know further that S/o" = Sn/o"n = ?n G N, where m is the number of outgoing 
links of an agent in the nBCC. Inserting S/cr = m in Eq.(|8]) yields (k) = 2m, showing 
that unidirectional links that are as attractive as bidirectional links can only occur 
in components in which mean degree, (k), is an integer multiple of 2. This matches 
the numerical data displayed in Fig. [7^, which shows that cTn/cTb = 1 is observed in 
components with (k) = 2 and (k) = 4. 

It is remarkable that observing (Xn = cib in a pair of collaborations is sufficient to 
determine the mean degree of the whole component. Moreover components in which the 
mean degree is exactly 2 have to consist of a single cycle potentially with trees attached. 
In the numerical investigations we mostly observe cycles of bidirectional links to which 
trees of unidirectional links are attached, as shown in Fig. [8b. 

In case b) the bidirectional links are more attractive targets for investments than 
unidirectional links. In typical networks with (Xb, a"n > crip this implies db < CTn. 
Now the stationarity condition, Eq. (j4]), demands that C"(Sb) > C"(Sn), so that 
unidirectional links receive a higher investment than bidirectional links. By contrast 



Patterns of cooperation 



15 



the total investment made by an agent investing in bidirectional links is higher than the 
one made by agents investing in unidirectional links, i.e. 



This relationship restricts the connectivity in the BCC to {k)Bcc ■= 2Sb/crb > 2, 
which implies (k) > 2, because the mean degree of the component cannot be smaller 
than 2 if a subcomponent already has a degree greater than 2. Therefore, we find 
that unidirectional links that are less attractive than bidirectional links only occur in 
components in which the mean degree is larger than 2, but not an integer multiple of 2 
(cf. Fig. [7^). As such links are only found at k beyond the giant component transition 
they occur typically in large components as shown in Fig. [H 

In numerical investigations, we also observe some unidirectional links in components 
with (k) < 2 (cf. Fig. [7b). To explain these we have to consider case b) but relax the 
assumption that both, and are above the IP. Thus, we obtain case c), about 
which we know that the unidirectional links are less attractive than bidirectional links, 
Sji < Sb, and that the unidirectional link only receives investments from one agent, 
i.e., (Tn < Sn- Moreover, {k) < 2 implies {k)Bcc < 2 and therefore Sb < cTb. Therefore 



which shows that unidirectional links can only appear in components with (k) < 2 if 
the investment received by unidirectional links is smaller than the investment received 
by bidirectional links. Satisfying < CTh and i?'(o'n) < -B'(o"b) simultaneously requires 
Cn < o"ip- The components with (k) < 2, in which such links are found, are trees formed 
by a core of bidirectional links, to which individual agents are attached by unidirectional 
links (Fig. [8^). Chains of unidirectional links, as we have observed in case a), cannot 
appear for (k) < 2 as this would mean that some agents would have one incoming and 
one outgoing link below the IP, which is ruled out by a trivial extension of the reasoning 
from Sec. [2l 

6. Conclusions 

In this paper we have proposed a model for the formation of complex collaboration 
networks between self-interested agents. In this model the evolving network is described 
by a large system of deterministic differential equations allowing agents to maintain 
different levels of cooperation with different partners. 

We showed analytically that bidirectionally communities are formed, in which every 
agent makes the same total investment and every collaboration provides the same 
benefit. In contrast to models for cooperation on discrete networks, the present model 
thereby exhibits a high degree of coordination which can be interpreted as a precursor 
of a social norm. We emphasized that coordination is generally achieved although single 
agents possess insufficient information for computing the total investment made by any 
other agent and although the level of cooperation that is reached in a community is not 
fixed rigidly by external constraints. 



0"b < CTn < Sn < Sb. 



(9) 



0"n < Sn < Sb < 0"b 



(10) 
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Despite the high degree of coordination, we observed the appearance of privileged 
agents, reminiscent of the leaders emergind in 27|. In the model proposed in the present 
paper, the privileged agents hold distinguished topological positions of high degree 
centrality allowing them to extract much higher payoffs than other agents, while making 
the same cooperative investment. However, we found that in the absence of further 
mechanism reinforcing differences the assembled topologies were fairer than random 
graphs. 

Although our primary aim was to investigate the formation of social networks, some 
aspects of the behavior of social agents are reminiscent of results reported in psychology. 
For instance our investigation showed that agents can react to the withdrawal of 
investment by a partner either by mutual withdrawal of resources or by reinforcing 
the collaboration with increased investment. Our analysis provides a rational which 
links the expected response to the withdrawal of resources to an inflection point of an 
assumed benefit function. 

Furthermore, we investigated under which conditions non-reciprocated collabora- 
tions appear. Here, our analysis revealed that such unidirectional collaborations can 
appear in three distinct scenarios, which can be linked to topological properties of the 
evolving networks. In particular exploited agents whose investments are not reciprocated 
invest less than the average amount of resources in their links when occurring in small 
components, but more than the average amount, when integrated in large components. 

We believe that the results from the proposed model can be verified in laboratory 
experiments in which humans interact via a computer network. Such experiments may 
confirm the topological properties of the self-organized networks reported here and may 
additionally provide insights into the perceived cost and benefit functions that humans 
attach to social interactions. 

Furthermore, results of the proposed model may be verified by comparison with 
data on collaboration networks between people, firms or nations. This comparison may 
necessitate modifications of the model to allow for instance for slightly different cost 
functions for the players. Most of these extensions are straight forward and should not 
alter the predictions of the model qualitatively. For instance in the case of heterogeneous 
cost functions, players will make different total investments, but will still approach 
an operating point in which the slope of their cost function is identical. Further, 
coordination should persist even if the network of potential collaborations is not fully 
connected. Finally, but perhaps most importantly our analytical results do not rely 
heavily on the assumption that only two agents participate in each collaboration. Most 
of the results can therefore be straight-forwardly extended to the case of multi-agent 
collaborations. 

Our analytical treatment suggests that the central assumption responsible for the 
emergence of coordination is that the benefit of a collaboration is shared between the 
collaborating agents, but is independent of their other collaborations, whereas the cost 
incurred by an agent's investment depends on the sum of all of an agent's investments. 
Because this assumption seems to hold in a relatively large range of applications we 
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believe that also the emergence of coordination and leaders by the mechanisms described 
here should be observable in a wide range of systems. 

The analysis presented in this paper has profited greatly from the dual nature 
of the model, combining aspects of dynamical systems and complex network theory. 
In particular our analytical investigations were based on the application of Jacobi's 
signature criterion to the system's Jacobian matrix. Apart from the symmetry of the 
Jacobian, this 'double- Jacobi' approach does not depend on specific features of model 
under consideration. The same approach can therefore be used to address significant 
extensions of the present model. We therefore believe that also beyond the field of social 
interactions, the double- Jacobi approach will prove to be a useful tool for the analytical 
exploration of the weighted adaptive networks that appear in many applications. 



Appendix A. Stability condition 



To determine the local asymptotic stability of the steady states we study the Jacobian 
matrix J G ]R^(^-i)><^(^-i) defined by J(ij){ki) = delj/deki- The terms contained in this 
matrix can be grouped into three different types 
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albeit evaluated at different points. For reasons of symmetry 
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and consequentially Pij = Pji, and Aij = Pij + K 
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. Ordering the variables according to 
j the Jacobian can be written in the 
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which is shown here for = 3. As each cooperation ij is determined by a 
pair of variables {eij,eji), each Pij occurs twice forming quadratic subunits with the 
corresponding entries Aij and Aji. Subsequently, we restrict ourselves to the submatrix 
of J, which only captures variables eij belonging to 'non-vanishing' links. As argued 
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before, 'vanishing links', i.e. links with 0"^ = 0, are subject to stationarity condition 
([5]). If C" (Sj) > B' (0), their stability is due to the boundary condition Cij > and is 
independent of the second derivatives of C and B. Hence, they can be omitted from the 
subsequent analysis. This means in particular that the spectra of different topological 
components of the network decouple and can thus be treated independently. 

All eigenvalues of the real, symmetric matrix are real. According to Jacobi's 
signature criterion the number of negative eigenvalues equals the number of changes 
of sign in the seq uence 1,-Di, . . . ,Dr where r is the rank of and Dg := det (J^), 
i,k = 1, . . . ,q SI]- In a stable system the sequence has to alternate in every step. A 
necessary condition for stability is therefore alternation in the first steps l,Di,D2. 

By means of an even number of column and row interchanges the above stated form 
of can always be transformed such that the first 2x2 block reads 

A.. p.. 

-f I'j 

P A ■■ 

Since we assume that ij is a non-vanishing link, and, hence, i and j to be in the same 
component, both agents make the same total investment S. It follows from definition 
( ]A.3|) that Ki = Kj =: K and therewith that Aij = Aji. Thus, the sequence l,Di,D2 
alternates if 

= P,j + K <0 A (A.4) 

D2 = {2Pij + K)K>0. (A.5) 

Equation flA.5|) stipulates that K and (2Pjj + K) have the same sign. Of the two possible 
scenarios 

(2P,j +K),K <0 and {2Pij + K) , K > (A.6) 

the second is ruled out by Eq. (]A.4[) : If K > 0, it follows from Eq. ( ]A.4[) that 
Pij < —K < 0, which contradicts (2Pjj + K) > 0. Hence, the necessary conditions 
for stability, Eqs. (lA.4p . (lA.Sp . require 

K <0 A {2Pij + K) <0 . (A.7) 

If either agent i or agent j has another bilateral link, say ik, it is furthermore 
possible to transform by an even number of row and line interchanges such that the 
first 2x2 block reads 



A, K 



(A. 



K Aik 

In this representation the sequence l,Di,D2 alternates if 

= Aij = Pij + K <0 (A.9) 

D2 = P^kPiJ + {Prk + Pij )K>0. (A. 10) 

Condition (lA.lOp can then be written as 

P,kP^, > -K {Pik + P^,). (A.ll) 

Inserting the definitions Eqs. (lA.l|) - (lA.3|) in Eqs. (]A.7|) and flA.ll|) yields the stability 
conditions cited in the main text as Eqs. ©-(ITl). 
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